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Ql^ , Several classical results on boundary crossing probabilities of 

■ Brownian motion and random walks are extended to asymptotically 

Gaussian random fields, which include sums of i.i.d. random variables 
with multidimensional indices, multivariate empirical processes, and 
scan statistics in change-point and signal detection as special cases. 
Some key ingredients in these extensions are moderate deviation ap- 
proximations to marginal tail probabilities and weak convergence of 
the conditional distributions of certain "clumps" around high-level 
crossings. We also discuss how these results are related to the Pois- 
son clumping heuristic and tube formulas of Gaussian random fields, 
, and describe their applications to laws of the iterated logarithm in 

' the form of the Kolmogorov-Erdos-Feller integral tests. 
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'sj" ■ 1. Introduction. The goal of this paper is to extend a number of clas- 

, sical results on boundary crossing probabilities of Brownian motion and 

I random walks to much more general stochastic processes involving multi- 

' dimensional indices (i.e., random fields). These extensions were motivated 

^ . by applications to signal detection and change-point problems; see Exam- 

^ I pie 2.2 and the last two paragraphs of Section 4. Other applications include 

the laws of the iterated logarithm for sums of i.i.d. random variables with 
multidimensional indices (see Section 3), Kolmogorov-Smirnov statistics of 
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multivariate distributions and sums of linear processes with long-range de- 
pendence (see Section 4). To begin with, let {Vl^(t) : t > 0} be Brownian mo- 
tion and let Tc = inf{t > : W{t) > bc{t)} be the first time when Brownian 
motion crosses a positive continuously difFerentiable boundary be- Strassen 
[34], Jennen and Lerche [22], Wichura [37] and others have shown that Tc 
has a density function pc and that under certain additional conditions on 
be, Pc has the "tangent approximation" 

(1.1) pc{t) = t~^/\c{tMbc{t)/Vi), 

where (p{x) = (27r)~^/^e~^^/^ is the standard normal density function and 
O'cit) = bc{t) — tb'c{t). Note that in the case of a linear boundary bc{t) = 
a + (3t (with a > and /? > 0), the well-known Bachelier-Levy formula yields 
Pc{t) = t~^^'^a(p{bc{t)/\/t), so (1.1) simply replaces a by the intercept adt) of 
the tangent line passing through {t,bc{t)), and is therefore called a "tangent 
approximation." For concave boundaries bc{t) = b{t) that become infinite as 
t ^ cxD, one typically has b'{t) = o{b{t)/t), so one can replace ac{t) in (1.1) 
by b{t). There is a close connection between this approximation to pdt) and 
the Kolmogorov-Erdos-Feller test, which yields for nondecreasing b{t)/\/t 
the 0-1 dichotomy 

{1.2)P{W{t) < b{t) for all large t} = 1 (or 0) if J(6) < oo (or = oo), 

where I{b) = t-^'%{t)^{b{t) /Vt)dt<oo. Similarly, if S„ = Xi + • • • + X„ 
with EXi = 0, EXl = 1 and E\Xi\^ < oo, then for all n>l, 

(1.3) P{Sn < b{n) for all large n} = 1 (or 0) if l{b) < oo (or = oo). 

If we think of the random walk {Sn,n > nd in (1.3) as an "asymptotic" 
Brownian motion as nc — > oo, then (1.3) can be regarded as the generaliza- 
tion of (1.2) to processes that behave like Brownian motion. This suggests 
that if (1.1) and (1.2) can be extended to more general Gaussian processes, 
then they may even be expected to hold much more generally for processes 
that are "asymptotically Gaussian." In view of the functional central limit 
theorem for sums of weakly dependent or long-memory random variables, 
the scope of applications of such results would be very broad. Unfortunately, 
functional central limit theorems, which are about the "central" part of the 
limiting Gaussian distributions, are not the right tools to handle the "rare" 
events in the high-level crossings as in (1.1) and (1.3). 

To extend (1.1) and (1.2) to much more general processes, our approach 
uses (i) moderate deviation approximations to marginal tail probabilities 
and (ii) weak convergence (to a limiting Gaussian process) of a certain con- 
ditional process given that the process attains a high level near the boundary 
at time t. Another key idea of our extension is to relax the requirement that 
the left-hand side of (1.1) be a first exit density. Instead we regard it as a 
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"local" exit density at time t so that the probability that the process ever 
crosses the boundary within time interval D is asymptotically equal to the 
integral of the right-hand side of (1.1) over D. Not only does this avoid 
the technical assumptions that need to be imposed to ensure that the first 
exit time Tc indeed has a density with respect to Lebesgue measure, but it 
also dispenses with the notion of having a well-ordered set D so that the 
"first" time of exit can be defined. This enables us to extend our approach 
to random fields (with multidimensional time that is not well ordered) . Sec- 
tion 2 gives basic assumptions for these "asymptotically Gaussian" random 
fields and states the main theorems that provide generalizations of (1.1) and 
(1.3). Applying these theorems to Gaussian random fields yields new results 
in Theorem 2.1 for the maxima of Gaussian random fields. Section 5 gives 
the proofs. Connections to Aldous' [4] Poisson clumping heuristic and the 
Hotelling-Weyl tube formulas are also discussed in Section 2. 

2. Basic results and discussion. We begin with some notation that will 
be used throughout the paper. Let 'ip{c) = {2'n(?)~^l'^ exp(— c^/2). For vectors 
t, u E R'^, the relation t<u means ti < Ui for all i and t <u means ti < Ui 
for all i. Also [-J will be used to denote the greatest integer function, || • || 
the (Euclidean) norm of a vector, | • | the determinant of a square matrix 
and v{-) the d-dimensional volume (or content) of a Jordan measurable set. 
For C > 0, let 



For L) C R*^ and 5 > 0, define [D]s = {t + u:t E D, \\u\\ < 6}. We shah also use 
V and to denote the gradient vector and Hessian matrix, respectively, 
of a function. Let S'^"^ denote the {d — 1) -dimensional unit sphere, and let 
Z+ (R+) denote the set of positive integers (real numbers). Let < a < 2 
and let {Wt{u) :u E [0, oo)'^} be a continuous Gaussian random field (whose 
continuity follows from Theorem 2.1 of [25]) such that 



d 



It,( = Y[[ti,ti + C)- 



1=1 



Wt{0) 
E[Wt{u)] 







..|rn(n/||n||)/2, 



(2.1) 



CoY{Wt{u),Wt{v)) 



[\\urn{u/\\u\\) + \\vrn{v/\\v\\) 

-\\u-vrrt{{u-v)/\\u-v\\)]/2, 



where rt : S' 



R+ is a continuous function satisfying 



(2.2) 



sup \rt{v) - ru{v)\ ^ 

WES'*-! 



as u 



t. 
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Of particular importance in the subsequent development are 
HK{t) = r eyp\ sup Wt{u) > y] dy, 

Jo io<u,<K Vi J 

(2.3) 

H{t) = lim K-'^Hxit), 

K^oo 

which are shown to be well defined in Theorems 2.4 and 2.5. 

Let X be a stationary, isotropic Gaussian random field such that £'X(0) = 
0, EX^{^) = 1 and 

(2.4) E[X{Q)X{u)] = l-{l + o{l))\\urL{\\u\\) as u ^ 0, 
for some < a < 2 and slowly varying function L. Let 

(2.5) Ac = min{x > 0:x"L(j;) = (2c^)"^}. 

For example, if L{x) = 1, then Ac = (2c^)~^/". Let D be a bounded, Jordan 
measurable set such that [D]^ lies in the domain of X for some (5 > 0. Then 
by Theorem 2.1 of [31], 

(2.6) p|supX(i) > cl ~ ^lj{c)A-'^viD)H, 

where H = limi^_>oo K~'^ e^P{supo<„.<j<- vi ^o('") > u} dy is a positive, 
finite constant and Wq is the Gaussian random field defined in (2.1) with 
ro(it) = 1. Our goal is to extend (2.6) first to more general Gaussian random 
fields satisfying 

(2.7) E[X{t)X{t + u)] = l-{l + o{l))\\urL{\\u\\)rt{u/\\u\\) as ^ 0, 

uniformly over t G [D]s. We then extend (2.6) to non-Gaussian random fields 
that are asymptotically Gaussian in a moderate deviation sense. 

2.1. Gaussian random fields. Let X be a Gaussian random field such 
that EX{t) = 0, EX^{t) = 1 for all t. Let D be such that [D]s is a subset of 
the domain of X for some 5 > 0. The following theorem, whose proof is given 
in Section 5, generalizes (2.6) far beyond the stationary isotropic framework 
considered by Quails and Watanabe [31] under (2.4). 

Theorem 2.1. Suppose the Gaussian random field X satisfies condition 

(2.7) , in which < a < 2 andrt: S'^"^ R+ is a continuous function such 
that the convergence in (2.2) is uniform int £ [D]s and supi^^Dj^ ^j^sd-i rt{v) < 
oo. Then, with H(t) defined by (2.3), 

(2.8) p( sup X{u)>c \ r^iii;{c)H{t) 
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uniformly over t £ D, as c —> oo and oo with ic = o(A~^). Moreover, if 
D is bounded and Jordan measurable, then as c— > oo, 

(2.9) p\supX{t) > cl ~ ^P{c)A-'^ f H{t) dt. 

UgD J JD 

The following special case of Theorem 2.1, with d = 2, demonstrates the 
usefulness of including the function rt on S'^"^ in (2.2) when (2.1) is extended 
to nonstationary Gaussian random fields. It will be discussed further in 
Example 2.10 and at the end of Section 4. 

Example 2.2. Let X{ti,t2) = {t2-h)-^/^[W{t2) -W{ti)], where W{-) 
is Brownian motion, and D = {(ti,t2) :0 < ti < t2 < a, ai < t2 — ti < 02} 
with < ai < 02 < a. Then 

E[X{t)X{t + u)] = l-{l + 0(1))^""'' ^ 



2{t2-h) ' 

as n— >0. Hence (2.7) is satisfied with a = 1, L(||ii||) = 1 and rt{u) = {\ui\ + 
\u2\)/[2{t2-ti)]. Therefore Ac = i2c^)~^ in view of (2.5), and H (t) = 2~'^ {t2 - 
ti)~^ by Lemma 2.3 below. Application of Theorem 2.1 then yields that as 
c — > 00, 

P{{t2-tl)-^/^[W{t2)-W{ti)]>C 

for some < ti < t2 ^ O) ^ ^2 — ^ ^2} 
(2.10) ~V(c)(2c2)^ / 2~^{t2-tiy^dtidt2 

JD 

ra2 ra—s 

= V'(c)(cV4) / / s^'^dtids 

Jai Jo 

= V'(c)(cV4)[a(ar^ - aa^) - log(a2/ai)]. 

Lemma 2.3. Let {Wt{u) : u G [0, 00)'^} be a continuous Gaussian random 
field such that for some positive functions . . . ,/3d, 

d 

E[Wt{u)] = -J2Pi{t)u,/2 

i=l 

and 

d d 

Cov[Wt{u),Wtiv)] =Y,Pi{t){ui + Vi- \ui - Vi\)/2 = Piit) mmim, Vi). 

1=1 i=l 

Then i/(t) = 2-'^nf=iA(i)- 
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Proof. For n > 0, Wt{u) =Yfi=iBi,t{ui), where {Bi^t}i<i<d are in- 
dependent Gaussian processes with independent increments, E\Bi,t{ui)\ = 

-Pi{t)ui/2 and Yav{B,^t{u^)) = Pi{t)ui, so = W{(3i{t)ui) - f3i{t)ui/2. 

As i^T —> oo, 



eyp{ V sup Bi^t{ui) >y\dy 

U=lO<n,<i^ J 

: / (e^ - 1)P<^ V sup Si.t(ni) G ^ 
JO ti=iO<«,<A- ' J 



i?< exp 



V sup Bi^t{ui) 



\\E\e^J sup [W{f3i{t)ui)-Pi{t)ui/2] 



so Hxit) ~ ni=i[A(*)-f^/2]; see [18], (1.8.11) for the last asymptotic relation. 

□ 



2.2. Asymptotically Gaussian random fields. Theorem 2.1 is derived in 
Section 5 as a special case of a more general result on asymptotically Gaus- 
sian random fields satisfying conditions (C) and (A1)-(A5) below. Specifi- 
cally, for c > 0, let Xc be random fields such that EXc{t) = 0, EX'^{t) = 1 
for all c and t. Let D be such that [D]s is a subset of the domain of Xc 
for some 6 > and all c large enough. Define pc{t,u) = E[Xc{t)Xc{u)]. In 
analogy with (2.7), assume that there exist < a < 2 and a slowly varying 
function L such that as m — > 0, 

(C) pc{t,t + u) = l-{l + o{imurL{\\u\\)n{u/\\u\\) 

uniformly over t G [Djs and compact sets of u/Ac > 0. Moreover, assume 
that the following conditions also hold uniformly over t G [D]s, as c— > oo: 

(Al) P{Xc{t)>c-y/c}r^i^{c-y/c) 

uniformly over positive, bounded values of y. The convergence in (2.2) is as- 
sumed to be uniform in t G [D]s, with sup^gpi^^^ggd-i rt{v) < oo. Moreover, 
for any a > and positive integers m, as c — > oo, 

{c[Xc{t + akAc) - Xc{t)] : < /c, < m}\Xc{t) = c-y/c 

(A2) 

{Wt{ak):0<ki<m} 
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uniformly over positive, bounded values of y, where we use "|Xc(t) = c — y/c" 
to denote that the distribution is conditional on Xc{t) = c — y/c. In addition, 
there exists a positive function h such that liniy^oo h{y) = and 

(A3) P{X,{t + uAc) > c - 7/c, X,{t) < c - y/c} < h{y)i>{c) 

for all M > and 7 > 0, and there exist nonincreasing functions Na on R+ 
and positive constants 7a such that 7a ^ and Nai'ja) + Ji°^^Xa{'ya + 
io) duo = o{a'^) as a ^ 0, and 

(A4) p{ sup Xc(t + uA,) >c,Xe(t) <c-7/cj <iVa(7)V(c), 

lO<u<a J 

for all 7a < 7 < c and s > 0. 

Whereas (Al) refers to the marginal distribution of Xc{t), saying that 
{Xc{t) > c — y/c} has probability like that of a standard normal, the joint 
distribution of Xc{-) is assumed in (A2) to be asymptotically normal in 
the sense of weak convergence for local increments conditioned on Xc{t) = 
c — y/c. Note that the same a,L(-) and rt{-) appear in (C) and the mean and 
covariance functions (2.1) of the Gaussian field Wt{-) in (A2). In fact, if Xc = 
X is a Gaussian field satisfying condition (C), then (A2) holds; see the proof 
of Theorem 2.1 in Section 5. Assumptions (A3) and (A4) are mild technical 
conditions under which the probability of sup„g/^ Xc{u) exceeding c can 

be computed via (Al) and (A2) after the cube It,KAc = Ili=i [^ij + KA^) is 
discretized by the grid points t + kaAc (0 < /cj < m) with a = K/m, leading 
to the following. 

Theorem 2.4. LetK>0. Assume (C) and (A1)-(A4) . Then as c^ 00, 
p\ sup X^{u)>c]^ij{c)[l + HK{t)] 

uniformly over t G [D]s, where Hxit) is defined in (2.3) and is finite and 
uniformly continuous in t £ [D]s. 

To derive an analogue of (2.6) for P {sup^^ Xc{t) > c} in which Xc satis- 
fies (C) and (Al)-(A4), we can sum the asymptotic formula in Theorem 2.4 
over t e [KAcZY n if the joint occurence of two events (associated with 
two such cubes) is negligible in comparison with the probability associated 
with a single cube. The following simple condition ensures this: There exists 
a nonincreasing function /: [0, 00) — > R+ such that /(||r||) = 0{e~^^^'^^^) for 
some p > and for all 7 > and c sufficiently large, 

(A5) P{X,{t) > c - -f/c, X,{t + nA,) > c - 7/c} < V(c - 7/c)/(||n||) 

uniformly in t and t + uAc belonging to [D]s. 
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Theorem 2.5. Assume (C) and (A1)-(A5). Then as c^oo and 
oo such that £c = o{A~^), 

(2.11) p| sup Xc('u) >cj ~£;?^(c)//(t), 

(2.12) p| sup Xc(u)>c, sup Xc(?;) >cj = o(£fV(c)), 

uniformly overt G D and over subsets B of [D]s with hounded volume, where 
H[t) is defined in (2.3) and is uniformly continuous and hounded below on 
D. 



Dividing (2.11) by {ic^c)'^, which is the volume oi It/^Aci yields an asymp- 
totic boundary crossing "density" /S.~'^ilj{c)H{t) of Xc at t. By integrating 
this "density" over D, or more precisely, by summing (2.11) over the "tiles" 
It,ic^c of ^ ^iid applying (2.12) together with the fact that D is bounded 
and Jordan measurable, we obtain the following generalization of the Qualls- 
Watanabe result (2.6) on stationary isotropic Gaussian random fields. 

Corollary 2.6. Assume (C) and (Al)-(A5). Let D he a hounded, Jor- 
dan measurahle set. Then 

(2.13) pjsup Xc(t) > cj ~V(c)A~'^ / H{t)dt asc^oo. 

IteD J Jd 

We can extend Corollary 2.6 to sets Dc that grow with c. The assumption 
that D be Jordan measurable [i.e., for any e > 0, the boundary dD of D can 
be covered by rectangles Ui, U2, ■ ■ ■ such that J2'^i villi) < e] and bounded 
in Corollary 2.6 is used to show that J2t£(czy,it c<^dDyt0 '^^(-^i.c) ^ as C — > 0. 
When working with sets Dc that need not be bounded, we need to impose 
a more direct assumption (2.14) on the contribution of dDc to the Riemann 
sum. Moreover, by condition (C) or (Al)-(A5), we now mean that it holds 
uniformly over t belonging to [-Dc]<5- 

Corollary 2.7. Assume (C), (Al)-(A5) and that 

(2.14) sup \\u-t\\ = 0{c'') and Cc H{t) = o{v{Dc)) 

for some k > and positive C,c with Cc ^ and Ac = o{C,c)- Then as 00, 



(2.15) 



p\ sup Xcit) > cl ~ V(c)A^^ / H{t) dt. 
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2.3. Boundary crossing probabilities. To extend the conclusion of Corol- 
lary 2.7 to the boundary crossing probability P{Xc{t) > bc{t) for some t € 
Dc}, we proceed similarly by using the probabilities pdt) = P{Xc{s) > bc{s) 
for some s G It,Cc} building blocks, where ^ is so chosen that 

(2.16) sup Afe = o(Cc) hence inf bc{t) ^oo] asc— >oo. 

t€[Dc]s V telDc]s J 

Whereas (Al)-(A5) are related to the time-invariant boundary c to be 
crossed by Xc{-), we can formulate similar assumptions when c is replaced 
by a time-varying boundary bc{-)- Let 

(2.17) b^= inf bc{u), bc= sup bc{u). 

u<^[Dc]6 we [Deli 

Analogous to (Al)-(A5), assume that the following conditions hold, as 
oo, uniformly in i G [Dc]s and b^/2 < z <bc- 

(Bl) P{X,{t)>z}r^i;{z), 

{z\Xc{t + akA^) - Xc{t)] :0<ki< m}\XJt) =z-'y/z 

(B2) 

{Wt{ak):0<ki<m}, 

for any o > and positive integers m, the convergence being uniform over 
positive, bounded values of 7; moreover, the convergence in (2.2) is assumed 
to be uniform in t G [Dc\s, with sup^gp^j^^^.^gd-i rt{v) < 00. In addition, there 
exists a positive function h such that limy_»oo h{y) = and 

(B3) P{X,{t + uA,) >z- j/z, X,{t) <z- y/z} < h{y)i;{z) 

for all M > and 7 > 0, and there exist nonincreasing functions Na on R+ 
and positive constants 7a such that 7a ^ and Na['^a) + Ji° ^^^^ai^a + 
Lo) du> = o{a'^) as a — > 0, and 

(B4) p{ sup X,{t + uA,) > z, X,{t) <z- -f/z] < Na{-f)ij{z), 

for all 7a < 7 < z and s > 0. Moreover, there exists a nonincreasing function 
/ : [0, 00) — > R_|_, with /(||r||) = 0{e~^^^^^^) for some p > 0, such that for 7 > 
and c sufficiently large 

(B5) P{X,{t) > z - 7/z, X,{t + uA,) > z - 7/z} < ip{z - 7/^)/(||n||) 
uniformly in t and t + uA^ belonging to [Dc]5- 

Theorem 2.8. Assume (C) and (B1)-(B5). Suppose that (2.14) and 
(2.16) hold for some k > and (^c — > and that 

sup [bl{t)-bl{t)]=o{l) 

t&lDchcc 

(2.18) 

where bc{t) = sup bc{u),bf.{t) = inf bc{u). 
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Then P{Xcit) > bdt) for some t G L>c} ~ Jjy^i;{bc{t))A~j^^^H{t) dt as c ^ 
oo. 

The next corollary specializes Theorem 2.8 to the case in which bc{t) = 
cb{t) for some positive function b possessing continuous second derivatives 
on [D]s, where D is a compact Jordan measurable set. Let bu = inf^g/j b{t) 
and assume that M = {t £ D: b{t) = 6d} is a g-dimensional manifold (with 
boundary) such that Vq{MndD) = 0, in which Vq denotes the g-dimensional 
volume element of the manifold. Let TA4'^(t) denote the normal space of 
the manifold at t. Letting {ei(t), . . . ,ed-q{t)} be an orthonormal basis of 
TA4-^{t), define the d x (d — q) matrix A(t) = {ei{t) ■ ■ -ed-qit)) and assume 
that V^6(t) := A'{t)\7'^b{t)A{t) is a positive definite q x q matrix for all 
t£M. 

Corollary 2.9. Suppose (C) and (B1)-(B5) are satisfied with a <2 
and Dc = D, a compact Jordan measurable set. Then as oo, 

P{Xc{t) > cb{t) for some t £ D} 

(2.19) 

~V(c6D)6^''^°A-^(27r/c'6D)(''-'')/' / \Vlb{t)\-'/^Hit)vq{dt). 

Jm 

Example 2.10. Let X{ti,t2) = {t2 - tx)~^/'^[W{t2) - W{ti)\ and = 
X as in Example 2.2, where W{-) is Brownian motion, and let bc{ti,t2) = 
[c2 + 21og(t2 - ti^f^]^/^ for some (3 > 1. Let D = {(ii,i2):0 < ii < ^2 < 
o, ai <t2 — ti <a2} where < ai < 02 < a. Arguments similar to those used 
to prove Theorem 2.1 in Section 5 can be used to show that (B1)-(B5) 
hold uniformly in t G [D]s and b^/2 < z <bc- Therefore by Lemma 2.3 and 
Theorem 2.8, 

P{{t2 - tir'/^[W{t2) - W{ti)] > [C^ + 21og(t2 - tl)-f]'/^ 

for some < ti < t2 < a, ai < t2 — ti < 02} 

~V'(c)(2c2)2 / 2-4e^^°g(*2-*i)(t2-ti)~^diidi2 
Jd 

= ^^r r\-^-^dt,ds 

4 Jai Jo 

^ c^ipjc) / a{a^~^ -a^~^) _ (af -a^) \ 
4 I (3-1 (3 J- 

2.4. Discussion and related literature. Our formulation of "asymptoti- 
cally Gaussian" random fields bears some resemblance to Aldous's [4] Pois- 
son clumping heuristic, which involves i.i.d. clumps of high-level excursions 
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of a stochastic process X{t), with the stochastic structure of the clump 
determined by the conditional limiting process [like that in (A2)] of normal- 
ized local increments. Whereas the Poisson clumping heuristic only suggests 
an asymptotic approximation Pjsup^g^) Xc(t) < c} of the form e"^'' with 
Pc — > 0, our approach actually gives a rigorous derivation of an asymptotic 
formula for pc- Instead of a single stochastic process X{t), our formulation 
involves a family of random fields Xc{t) with EXcit) = and \ai{Xc{t)) = 1. 
It consists of two basic components: (i) a normal approximation to the prob- 
ability of Xc{t) exceeding some high level (depending on c) in (Al) or (Bl), 
and (ii) the weak convergence of the finite-dimensional distributions of the 
local increments conditioned on Xc{t) = c — y/c in (A2) [or (B2)]. The co- 
variance structure of the local increments given by condition (C) and the 
closely related mean and covariance functions (2.1) of the limiting Gaussian 
random field in (A2) [or (B2)] provide the key ingredients in the asymp- 
totic formulas in Corollaries 2.6, 2.7 and Theorem 2.8. Theorem 2.1 and its 
proof show that these asymptotic formulas are the same as in the special 
case Xc = X , a zero-mean Gaussian random field satisfying condition (C). 
These asymptotic formulas are derived by adding up corresponding results 
for small cubes in (2.11), making use of (2.12) to justify the additivity. 

Conditions of the type (A2) were introduced by Berman ([6], Theorem 5.1) 
for asymptotic approximations (as c — > oo) to the probability P{supo<t<7^ X{t) > 
c} of a stationary process X{t) (with d = l) such that X(0) belongs to the 
domain of attraction of an extreme value distribution; see [6], Theorem 14.1 
and [3], Theorem 1. We consider here general d, extend X{t) to Xc(t) and 
remove the stationary assumption, but restrict the limiting distribution in 
(A2) to be Gaussian and the marginal probabilities P{Xc{t) > c — y/c} to be 
asymptotically normal. It will be shown in Sections 3 and 4 that extending a 
single stationary process X{t) to a family of possibly nonstationary random 
fields Xc{t) and generalizing the threshold c to a moving boundary bc{t) 
greatly broaden the scope of applications. Some of the difficulties in proving 
these extensions to the nonstationary setting are explained in Remark 5.1. 

Corollary 2.9 and its proof in Section 5 reveal similarities and differences 
between our approach and the tube formulas of Hotelling [21] and Weyl [36] 
whose applications to the maxima of Gaussian random fields are reviewed 
in Section 6 of [1]. As in [8], the use of the tubular neighborhood U^^ of the 
extremal manifold Ai in the proof of Corollary 2.9 is related to Laplace's 
method for asymptotic evaluation of the integral V(^c(i))A^'^^^if(t) dt, in 
which the integrand can be regarded as an "asymptotic density" of crossing 
the boundary be by Xc at t (see the paragraph following Theorem 2.5). 
Differential geometric considerations arise naturally in applying Laplace's 
method to integrate the asymptotic boundary crossing density, and clearly 
also in the Euler characteristic and tube formulas of excursion sets in [1]. 
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3. Sums of i.i.d. random variables with multidimensional indices and as- 
sociated Kolmogorov Erdos Feller test. Let IkjkG Z5^, be i.i.d. random 
variables with 

(3.1) EYk = 0, EY^ = 1, ^|yk|^<oo. 

Let Sn = X]k<n^k5 where k < n denotes that ki < rii for I < i < d, as 
in Section 2. Let |n| = nr=i^j' logn = (logni, . . . ,lognrf) and exp(t) = 
(exp(ti), . . . , exp(trf)). Define X(logn) = |n|~-'^/^5n and extend the domain 
of X to [0, oo)'^ by defining -'^(t) = X(logn) when logjij <ti< log(nj + 1) 
for aU i. Let = X , Pc = p and let D^. be a Jordan measurable subset of 
{t : J2i ti>c^}- If t = log n and t + u = log m for some m, n G Z'^ , then 

1 - />(t,t + u) = 1 - Cov(|n|-i/25n, |m|-i/2Sn,) 

(3.2) 



as u ^ 0. From (3.2), it follows that (C) holds with a = 1, L{x) = 1, rt{u) = 
J^iWilf^^ and therefore Ac = (2c^)~^ by (2.5). Moreover, by the Berry- 
Esseen theorem (cf. [15], Theorem 16.4.1), for logn < t < log(n + 1), 



(3.3) 



P{X{t) > c - y/c} - / (27r)-i/2e--V2 

Jc~y/c 



0(\n\''/^) 



uniformly over c and y. Since log|n|/c^ 00 uniformly over t G [-De] 5, it 
follows from (3.3) that (Al) holds. Moreover, as will be shown in Lemma 3.6, 
(A3) and (A4) are satisfied uniformly over [Dc](5- If we assume in addition 
that for some e > and k> 0, 

(3.4) sup ||u-t|| =0(0") and [L>c]5 C Ge; := J t : / ^ > e for alH i , 

then Lemmas 3.5 and 3.7 show that (A2) and (A5) also hold. Therefore 
X{t), t G Dc, is asymptotically Gaussian, and we shall apply Lemma 2.3 and 
Corollary 2.7 at the end of this section to prove the following two theorems. 



Theorem 3.1. (i) Assume that for some positive — > with Ac = o(Cc); 

Cc 



(3.5) Cc l{t G (CcZ)^ : ndD,^0}\= o{v{D,)) 



as 00. Then P{s\iVteD,^{^) > c] = 0{:v{Dc)c^'^tp{c)) . 
(ii) // (3.4) also holds, then 

(3.6) p( sup X{t) > cl ~ 2-'^t;(Z)c)c2'^^(c). 
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Theorem 3.1(i) enables us to extend the Kolmogorov-Erdos-Feller test 
(1.3) to the case of multidimensional time. Let /3:Z^|. — > (0, oo) be nonde- 
creasing in the sense that /3(m) < /3(n) for all m < n. We say that (3 is an 
upper (lower) class function if 

(3.7) sup{|n|:|n|-^/25^>^(jj)| < ^^ g^ 

For e > 0, let -F^ = {n € Z^^ : logn,j/log |n| > e for all i}; in particular Fq = 
Z%. Define 

(3.8) Je=Y. |nrV2"-i(n)e-^'(")/2. 

Theorem 3.2. If Jq < oo, then [3 is an upper class function. Conversely, 
i/ Jg = oo for some e > 0, then (3 is a lower class function. 

Example 3.3. In the case d = 1, since xe"^^/^ is decreasing in x > 
1, it follows that /f'i-3/26(i)e-'''W/2i^^ < oo iff n-i;g(n)e-^'(") < oo, 
where (3{n) = h{n)/y/ri is nondecreasing. Therefore the integral test (1.3) is 
equivalent to Theorem 3.2, noting that = Jq for all < e < 1 in the case 
d = l. Next consider d = 2 and let /? be a positive function on such that 

^ n2-V(n)e-^'(")/2 = oo, 

ni=l,n2>l 

^K-i/3(n)l|„,=i} + |nri/33(„)l^„^>2}]e-^'(")/^ < oo. 

n 

Then sup{|n| :|n|~-^/25n > /3(n),?ii > 2} < oo a.s. and sup{n2 : "^^^S'n > 
P{n),ni = 1} < oo a.s., by the first part of Theorem 3.2. On the other hand, 
Jo = oo although Jg < oo for every e > 0. This shows the importance of using 
Je instead of Jq for the lower class result in Theorem 3.2. 

Let /?(n) = {(2 + 6) (iloglog |n|}i/2 fgj. j^j > g 5>0. Then by the in- 
equality J2i=i logrij > (nf=i lognj)^/"^ between arithmetic and geometric 
means, there exist C,C' > such that 

Jo<C ^ (loglog|n|)'^-V2/{|n|(log|n|)<i+'5/2)} 
<C'A E nrHlogn,)-(^+^/3), 

i=l riiSZ-i- 

so Jo < OO if 5 > 0. Take < e < and note that the number of k's such 
that X^i^i = ''^ ^-iid ^ -^e (so that fcj > em) is {B + o(l))m'^~^ for some 
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B > 0. Since Yli=iJ2e''i-^<ni<e''i ' ~ 1 minA;, — > oo, it follows that if 
6 = 0, then there exists B'~> such that 

Js> |nr^(log|n|)-'^>B' rn~^ = oo. 

nG_FE:,n>no m>mo 

Hence by Theorem 3.2, /3(n) belongs to the upper class if 5 > and to the 
lower class if 5 = 0, yielding the following. 

Corollary 3.4. limsup[n|_^oo5n/(2(i|n| loglog|n|)^/^ = 1 a.s. 

In the case d = 2, Zimmerman [38] proved an analogue of Corollary 3.4 
for the Brownian sheet, which is a zero-mean Gaussian random field with 
independent increments and variance function |t|, like that of S^- His result 
was subsequently strengthened by Orey and Pruitt ([26], Theorem 2.2) who 
proved that for the d-dimensional Brownian sheet W(t), i-*{PF(t)/|t| < /(|t|) 
for all large |t|} = 1 (or 0) if 

/oo 
CHlog^y~\loglog^f-^/^e-^^^^/^d^ < (or = )oo. 

Actually their result considers t — > rather than |t| — > oo. However, as 
|t|iy(l/ii, . . . , l/td) is also a Brownian sheet, one can extend their integral 
test to the preceding statement. Because continuous Gaussian processes (in- 
stead of discrete-time sample sums) are involved, the tail distribution of the 
maximum over a domain Dc does not require condition (3.4); see (2.6) in 
this connection. Hence unlike (3.8), the integral test (3.9) does not involve 
F^. Instead of the series (3.8), we can rewrite it as an integral when Ff, is 
not involved, expressing the convergence criterion in Theorem 3.2 (taking 
e = 0) as the integral test 

(ti---td)-V"'(ii,---,id) 

(3.10) 

X e-^'(*i'-'*'*)/2 dti--- dtd < (or = )c3o. 

Note that (3.10) considers more general functions /3(t) than those of the 
form /(|t|) considered by Orey and Pruitt [26]. In the case /3(t) = /(|t|), 
assuming without loss of generality that cq < /(C)/ (log logC)'''^ — for some 
< Co < ci (see the proof of Theorem 3.2), the change of variables ^ = ii • • • id 
in (3.10) shows that (3.9) and (3.10) are indeed equivalent. 

Strong approximations of Sn have been developed by Rio [32] who has 
shown that if Yk, k e Z:[, are i.i.d. with EYi, = 0, EY^ = 1 and E\Yi,\'' < oo 
for some r > 2, then redefining the random variables on a new probability 
space yields 

(3.11) sup |Sn-T^(n)| =0(l/('^-l)/2(iQg^)l/2^^<i/r^ 

0<n<ul 
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Note that (3.11) bounds the approximation error — W{n) by 

\(d-l)/2/ \l/2 / ^d/r 

max Tii I [ log max nj ) + [ max rij 

,l<i<d / V l<i<d ) \l<i<d 

instead of by some sufficiently smaU power of |n| = nf=i ^j- Therefore Rio's 
strong approximation (3.11) cannot be combined with the Orey-Pruitt in- 
tegral test (3.9) for W(t) to yield a corresponding integral test for Sn- Ex- 
ample 3.3 shows that the integral test (3.9) for W{t) actually does not hold 
for Sn which requires a more subtle criterion for a lower class of functions. 

The proof of Theorem 3.1 uses the following three lemmas which show 
that (A2)-(A5) hold under (3.4). 

Lemma 3.5. Assume (3.4). Let u,v>0. Then as c —>■ oo , 
E{c[X{t + uA,) - X{t)]\Xit) = c - y/c} 



(3.12) 



d 



i=l 



Cov{c[X(t + uAc) -X(t)],c[X(t + vAc) -X(t)]|X(t) = c-y/c} 

(3.13) 

d 



'^mm{ui,Vi)/2, 



i=l 



uniformly over bounded values of y and t £ [Dc]s- Hence (A2) holds. 

Proof. For exp(t) G Z'l and exp(t + uAc) G Z'^, define 
^t(u)= 

{k: k<cxp(t+uAc)}\{k: k<cxp{t)} 

(3.14) 

= X{t + uAe) exp|^(ti + ^XiA,)/2| - X{t) exp . 
Conditioned on X{t) = c — y/c, 

c{X(t + uAe)-X(t)} 



(3.15) 



cZt(u) expj- ^(ti + UiAe)/2| 
- c(c - y/c)|l - exp^-Ac^Ui/2^ | 
cZt (u) exp ( - ^ U/2 - A, ^ n,/2 J - ^ n,/4 + o(l). 

\ i i / i 
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Since .^t(u) is independent of X(t), (3.12) follows from (3.4) and (3.15). To 
see this, suppose log nj < + uAc < log(nj + 1) and log nii <ti < log(mi + 1) 
for 1 < i < d. By (3.4), U >eJ2j tj > for t e [Dc]s and all large c. This 

implies that log(mj + 1) — logmj = log(l + m^^) < log(l + e"^*^^/^) = o(Ac) 
and that log(nj + 1) — logrij = o(Ac), so by (3.14) and (3.15), 

E{c[X{t + uA,) - X{t)]\Xit) = c - y/c} 

d d 

= - ^(lognj - logmi)/4Ac + o(l) ^ - ^ Ui/4. 

i=l i=l 

Similarly, for u, v > 0, 

d 

Cov(Zt(u),Zt(v)) ~ ]^{exp(tj + min(iii,t>i)Ac) -exp(tj)} 

i=l 

(3.16) 



^min(Mi,fi)Ac| exp^^tj^ 



and (3.13) follows from (3.4), (3.15), (3.16) since ^t(v) is also independent 
oiX{t). □ 

Lemma 3.6. (i) P{maxk<n 5k > A} < 2''P{Sn > A - d(2|n|)V2}. 

(ii) There exists a positive function h, with limj,^oo h{y) = Q, satisfy- 
ing (A3). 

(iii) There exist nonincreasing functions Na on R+ and positive con- 
stants 7a such that 7a 0, Naija) + J^y^'Xai^a + y) dy = o{a'^) for all 
s > 0, as a — > 0, and (A4) holds. 

Proof. For (i), see [17], Lemma 2.3. To prove (ii), let u > 0, u; > 0, 
7>0. By (3.15), 

(3.17) c[X{t + uA,) - X{t)] < (1 + o(l))cZt (u) exp ^ tjl^ . 

Since |{k:k<exp(t + uA,)}| - |{k : k < exp(t)}| ~ (Ei ^^i/2c2) exp(Ei ti), 
it follows by the independence of .^t(u) and X{t) and the Berry-Esseen 
theorem that for large c, 

P{c[X{t + uA,) - X(t)] >y'- 7|X(t) = c - y'/c} 

(3.18) < p|zt(u) > [{y' - 7)/2c] exp(^tj2^ | 

< ^P{Biy' - 7)) + O (^cexp ^ t,/2^ ^ 
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for some B > 0, uniformly over 7 < y' < ujc. In view of (Al), we can choose 
^ such that P{X{t) > c—y' /c} = (l+0{^'^))ilj{c—y' /c) uniformly over 
7 < y' < ^c- Let yj=y + j^c, i = 0, 1, . . . . Then by (3.18), 

P{X{t + uAc) > c - 7/c, c-LO< X{t) <c- y/c} 

< P{X(t + uA,)>c-7/c|X(t) = c-y7c} 

0<j<{LUC-y)/iJy^ 

X P{X{t) G c - dy'/c] 
V^(S(%-7)) + 0(^cexp|-^t,/2| 

X [P{X{t) > c - y,+i/c} - P{X{t) > c - yj/c}] 



< E 



(3.19) 



<(l + o(l)) E 

0<i<(i.^c-y)/5, L 



+ oicexp\-J2ti/2 



Cce^^V'(c) 



<V'(c) 



(1 + 0(1)) 



X J^\y'i,{B{y' -^))dy' + (^cexp|u;c - E^^/^j) 

Since Y^iU > c^ cexp(u;c - Y.iU/'^) = o(l). Moreover, e^' ij{B{y' 
7)) dy' ^ as y — > 00. From (3.17) and (3.18), it follows that for large c, 

P{[X{t + uAe) - X(t)] > cu} < p|^t(u) > (cu/2) exp (^E*^/^) } 

< Tp{Bao) +o(^cexp(^-J2ti/2^^ 



(3.20) 



0(^^(0)) 



if we choose uj> B ^ . Hence (ii) follows from (3.19) and (3.20). 

To prove (iii), note that {k:k < exp(t + alAc)} \ {k:k < exp(t)} = 
Ujc{i,...,<i},J^0^^' where Aj = {k:exp(ii) < h < exp{ti + aAc) for i G J 
and ki < exp(tj) for i ^ J}. By (i), 



p{ sup Ztiu)>z] 

lo<u<al J 
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(3.21) < ^1 sup E ym>z2~A 

JC{l,...,d},J^0 [^^^J m<k,m£Aj J 

<2'^ E We Y^>z2-^-d{2\Aj\)'/A. 

JC{l,...,d},J¥=0 ImeAj J 

Since \Aj\ ~ (aAc)''^' exp(X]j tj)) follows by (3.17), (3.21) and the Berry- 
Esseen theorem [using the same steps as in (3.18)] that for large c, 

p( sup c[X{t + uA,)-X{t)]>y'\X{t) = c-y'/c} 

lo<u<al J 

(3.22) <p\ sup Zt(u)>(y72c)exp( Vt,/2) I 

[0<u<al V i /J 

< A'^i^iB'y'/a'/' - 2''^d) + O [c" exp ^ t,/2 j j 

for some B' > 0, uniformly over 7 < y < wc, and therefore 

pic-a;<X(t) <c-7/c, sup X(t + uAc)>c 

I 0<u<al 



(3.23) < V'(c) 4^^ / ey'ij{B'y' /a^'^ - 2^2^) dy' 

+ o[c'^ei^v(^c-Y,ti/2j^ . 

Since E^^^>c^ ©(c'^expjwc - Ejti/2}) = o(l). By (3.17), (3.21), (3.22) 
and (i), 

p\ sup [X(t + uAc) -X(t)] >cj1 

lo<u<al J 

(3.24) < pj^^sup ^Zt(u) > (u;/2)exp|^^ti/2^ | 

< A'^iP{B'cuj/a^'^ - 2^/^d) + O (^'^ exp J2 ) 

for all large c. Let 7^ = a^/^ and take lij > a^^^/B' so that ip{B'cuj/a^/'^ — 
d2^l'^) = o{il){c)). Recalling that Y^iU > c^ it follows from (3.23) and (3.24) 
that for all large c and 7a < 7 < c, 

p\ sup X(t + uAc) >c,X(t) <c-7/cl 

lo<u<al J 
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< iPic) / b'^ey iP{B'y'/a'/^ - 2^/'d) dy' = ^{c)Na{-f), 

with Naija) + /r y'Naila + v) dy = o{aP) for all s > and p > 0. □ 

Lemma 3.7. Assume (3.4). For 7 > 0, there exist positive constants 
Bi,B2 and rj such that 

P{X{t) > c - 7/c, X{t + uAc) > c - 7/c} 

(3.25) 

<Bi exp(-S2||uf )V^(c-7/c) 
uniformly over t,t + uAc G [^c](5- Hence (A5) holds. 

Proof. For exp(t) G Z^f. and exp(t + uAc) S Z![, 

P{X{t) > c - 7/c, X(t + uAc) >c- -f/c} 

(3.26) 

< P{X{t) + X(t + uAc) > 2(c - 7/c)}, 

in which X(t) +X(t + uAc) is a sum of H^Li ™ax(e*% e**"'"*'»^'=) random vari- 
ables, each of the form (exp(- ii/2)l{k<exp(t)} +exp{- X;i(*i + ^^j^c)/2} x 

-'-{k<cxp(t+uA, 

^)|)yk. Since E^^^>c^ X(t) + X(t + uA c) is a sum of at least 
exp(c^) i.i.d. random variables. Using this and Var(X(t) +X(t + uAc)) = 
2(1 + p{t,t + uAc)), we then obtain by the Berry-Esseen theorem that 

P{X{t) + X{t + uAc) > 2(c - 7/c)} 

(3.27) 

By (3.2), there exists ( > such that 1 - p{t,t + uA^) > A^Ej hil/4 if 
AcEiKil <C- Moreover, 1 - p(t, t + v) = 1 - exp(- Ei bi|/2) > ^ := 1 - 
if Eibil >C- Since 

2(c-7/c)2 

-0 



l + p(t,t + uA< 

<,„_,/„(l±*|±^)"^ 

c-7/c)2(l-p(t,t + uA,)) 



X exp 



< V'(c — 7/c) exp 



2(l + p(t,t + uAe)) 

(c-7/c)2(l-p(t,t + uA,)) 



(3.29) 



<E 

uent 
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it follows from (3.26) and (3.27) that for all large c, 

P{X{t) > c - 7/c, X{t + uAc) > c - 7/c} 
(3.28) <V'(c-7/c) 

exp ^ |t.,|/33^ |„^|<^| + e-'^'^/^l^^^ 

Since t and t + uAc belong to [Dc]s and since supt^ve[Dc]« 11^ ~ ^11 ~ 0{c'^) 
by (3.4), it follows that J2i \ui\ < Vd\\u\\ = 0(0"+'^). Hence (3.25) with ry < 
min{l, 2/(k + 2)} follows from (3.28). □ 

Proof of Theorem 3.1. We have already shown that conditions (C), 
(Al), (A3) and (A4) are satisfied and that (A2) and (A5) also hold under 
(3.4). Let Ht = {t + kAc G /t,c, : k E Z"^}. Note that CJA^ 00 and that 

p( sup X{u) > c] 

P{X{u)>c-l/c} 

+ p\x{t)<c-l/c, sup X{u + vAc)>c\ 

I 0<v<l J . 

= 0{{Cc/A,yi;{c)), 

by (3.3) and (A4). By adding up (3.29) over {t G {Cc'Zf : It,Cc nDc^0},it 
follows from (3.5) that P{suptgz)^ X(t) > c} = 0(z;(L>c)A^'^V'(c)). By (3.2) 
and Lemma 2.3, H{t) = A''^ . If (3.4) also holds, then (Al)-(A5) ah hold and 
Corollary 2.7 can be applied to give (3.6). □ 

Lemma 3.8. Let (3: Z_|_ — > (0,oo) he nondecreasing and such that P{n) < 
{3(iloglog|n|}^/2_ Uf^fine by (3.8) and /ei c(t) = /3([exp(t)J ) /ortER^, 
c(0)=/3(l). 

(i) // Jo < 00, then Ek>oC^'^"nk)e-^'('^)/2 < 

(ii) Let wi = 2 and Wj+i = Wj + logu;^ for j > I. Then Wj ~ jlogj as 
j 00. For k G Z^J., define the rectangle L^^^ = HiLil^^fci, ^fc^+i) o.'i^d let 
Wk = {wk^, . . . ,Wk^). Assume furthermore that /3(n) > {dloglog |n|}^/^ and 
Jfri = 00 for some e' > 0. Then for every < e < e', 

(3.30) v{I^^^)c^'^-\w^)e-'''^'^^'^/^ = 00, 

k>3:/('')cGE 

where Gs is given in (3.4) and v{-) denotes volume of the rectangle. 
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Proof. Note that x^'^~^e~^^ /"^ is decreasing for x > xq. Since (3 is non- 
decreasing and there are only finitely many n's with /3(n) < xq in parts 
(i) and (ii) of the lemma, we can assume without loss of generality that 
^2(i-i^j^jg-/3 (n)/2 -g (decreasing in n. Therefore 

Jo>Y.\ E |n|-4c2'^-i(k + l)e-^'('^+i)/2 

k>0 In: e'=i<ni<e'=i+l 
k>l 

noting that |n|~'-'^ > JliLi e"^'^*"'"^) if e'^' <ni < e^^^'^ for all i and that {n : e^^ < 
Hi < e^'"*"^ for all i} has at least nf=i(6^'^^ — e^' — 1) elements. A similar 
argument also shows that for any {ii, . . . ,ij} C {1, . . . ,d}, 

J2 c2'^-^(k)e-'='W/2<oo. 

k:fei-|^ =---=fci^. =0,fci>l for ...,«_,} 

To prove (ii), first consider the case d=l for which = Jq. Here (3.30) 
follows from Jq = oo. 



n>e^ fc=2 '>cxp(iOfc)<n<cxp(uH;-|-i) J 

(3.31) 

and Eexp(«;fe)<n<exp(«;fe+i) ^ < " U^fc + 1 = u(/^''^) + 1. 

We next consider the case d>l. Since there are finitely many n's belong- 
ing to Z^|. such that logn e G^i \ (Uk: mmfe,>3 7{k)cGe: ^^^^)^ there exists C > 
such that 

4= ^ |nr 1/32^-1 (n)e-^'(")/2 

lognGG^/ 

= C+ E I E |n|-^/3^'^"^(n)e-/^^(")/4, 

k>3: /('')cG£ Mogne/{k) J 

which we can bound as in (3.31) to obtain (3.30) if J^/ = oo, noting that 

E inr'<n( E nA<\[{w,^^,-w,^ + i), 

logne/(k) «=1 ^Gxp{«ife^)<ni<cxp(«)fe._|_i) / i=l 

and that n.f=i(^^fc,+i - + 1) ~ f (/('')) as mini^i^dh ^ oo. □ 

Proof of Theorem 3.2. Suppose the theorem holds under the addi- 
tional assumption /3(n) < {3(iloglog |n|}^/^. To show that it also holds with- 
out this additional assumption, define /3(n) =min{/3(n), (3(iloglog |n|)^/^} 
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for an arbitrary function (3 : Z'^ — > (0, oo). If Jo(/3) < oo, then Jo(/3) < Jo{P) + 
Jo({3(iloglog |n|}^/^) < oo and hence 

sup{|n| : 5n/|n|i/2 > ^(^)| < sup{|n| : SJ\n\^/^ > /3(n)} < oo a.s. 

If Jx{P) = oo, then Jx{(3) = oo, so sup{|n| : Sn/jnl^/^ > /3(n)} = oo a.s. Since 
sup{|n| : S'n/lnl-'^/^ > (Sdloglog |n|)^/^} < oo a.s., it then follows that sup{|n| : 
5n/|n|i/2>/3(n)} = oo a.s. 

Define c(t) as in Lemma 3.8. In view of the preceding paragraph, we shall 
assume that c(t) < {MlogCEiti)}^^"^ [and hence J^iU > c^{t) for large t] 
and there is no loss of generality. We can apply Theorem 3.1 to Dc = /k,i 
[noting that (3.5) clearly holds for such cubes with unit width] and combine 
the result with Lemma 3.8(i) to conclude that if Jq < oo, then 

sup Xit)>c{k)\=o(j2c^''-\k)e-''"^''^A<oo, 

k>0 '-tG/k,! J Vk>0 / 

and therefore J2]f.>o > for some n with logn G /k,i} < oo. 

Hence by the Borel-Cantelli lemma, P is an upper class function if Jq < oo. 

Suppose Jx = oo for some A > 0. Take < e < A. To prove that /3 is a lower 
class function, we can assume that /3(n) > {dloglog jnj}^/^, using an argu- 
ment similar to that at the beginning of the proof to show that the assump- 
tion leads to no loss of generality. For notational simplicity, we focus on the 
case d = 2, as extension of the proof to d > 2 is straightforward and the case 
d = l does not involve multivariate considerations. Define the rectangles I^^^ 
as in Lemma 3.8(ii) and partition the set {k > 3 : I^^^ C G^} of bivariate vec- 
tors k = (fci , /C2) into four disjoint sets Ai, . . . , A4 so that ki is odd in ^1 U A2 
(and even in ^3 U ^4) while k2 is odd in Ai U .A3 (and even in A2UA4). Since 
the number of k's belonging to Gx \ (Uk>3- /(^jcGe ^^^^) finite and since 
t;(/(k)) = {wk^+i - Wk^){wk2+i - Wk^) ~ f(/(''"^)) as min(/ci,fc2) 00, it fol- 
lows from Lemma 3.8(ii) that Ej=i Eke^, «(-^^''"^^)c^"'"n'»^k)e-^'('"'')/2 = 
00, and therefore there exists j such that 

(3.32) K^^'^"'^)c"'"'(«^k)e-^'(""')/' = 00. 

kG.A, 

Since /3(n) > {dloglog |n|}V2, c{w]^) = Pde""^]) > (d + o(l))i/2(log |ii;k|)^/^; 
on the other hand, Wk^ — Wki-i = logWfcj-i, showing that (3.4) holds with 
Dc = K = 2 and c = c(W) + '^/c{wk). Clearly, Dc = /^''"^^ also satis- 

fies (3.5), so Theorem 3.1(ii) can be applied to conclude that 

J2 pI sup X{t)>c{wi,) + 2/c{wi,)\ 

~e-2 ^ ^;(/(k-i))c2'^-i(^^)e--^(-')/V(4V2^)=oo, 
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in view of (3.32). This implies that 

^ P{Sn/\n\^^^ > Pin) + 2/ciw],) for some n with logn e /C^^^)} 

(3.33) 

= oo. 

Write n' < m < n to denote n'- < rrii < rii for all i. For logn £ 



define 5^*"^ = E[cxp{^ 
(3.34) Y.P{ '^^P |Sn-5(''V|nr/'>l/c(ii;k)j<oo. 

kGytj Mogne/(k-i) J 

From (3.33) and (3.34), it follows that X^keyij ^(^k) = co, where 

Fk = {S(,''V|n|^/^ > /3(n) + l/c('u;k) for some n with logn G I^^''^'^]. 

Since the are independent events, P{F\^ i.o.} = 1 by the converse of 
the Borel-Cantelli lemma. Applying the Borel-Cantelli lemma to (3.34) and 
combining it with P{Fk i.o.} = 1 then show that P{5n/|n|-^/^ > /9(n) i.o.} = 
1. To prove (3.34), let v = [exp(?i;k_2)J and note that 



{«;k-2)J<m<n^m- We shaU show that 



Q _ C{k) . 

We shall show that 
(3.35) ^ p\ sup 

keA Uogn6/(k-i) 



mi<ni,m2<V2 mi<vi ,m2<n2 m<v 



E 

m\<.n\,m2<V2 



>l/{'ic{W]^)) \ <oo. 



Observe that Emi<ni,m2<t;2 ^m/|n|^/2 = X(logni,'u;fc2_2)(f2/n2)^/^ and 
V2/n2 < exp(tt)fc2„2-^t'fc2-i) = ^fc2-2' and that for large kG^j, w^^_2/ {2,c{w\^)) > 
(3(ilog |t(Jk|)^^^. Therefore 



sup 

JognG/C'-i) 



E 



mi<ni,m2<V2 



|n|V2>i/(3c(^j^)) 



<P{ sup \X{t)\>{3dlog\wk\)^/A=0{{ki + k2y^) 

for some A > 2, by Theorem 3.1(i). Since /(I'-i) C G,, this proves (3.35). □ 

4. Other applications. Section 2 provides a set of general conditions un- 
der which the asymptotic boundary crossing density approximation in The- 
orem 2.8 is shown to be valid. Given a specific application, one needs only 
to verify that these assumptions are satisfied. In particular, such verification 
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has been carried out for sums of i.i.d. random variables with multidimen- 
sional indices in Section 3, and we begin this section by carrying out sim- 
ilar verification of (C) and (B1)-(B5) for multivariate empirical processes. 
Let Yi,Y2, ... be i.i.d. d-dimensional random vectors with common distribu- 
tion function F, and let Fn{t) = ^27=1 ^{Yi<t}j * ^ ^'^^ be the empirical 
distribution function of Yi, . . . ,Yn- Let Zn{t) = ■^/n{-F„,(t) — F{t)} be the 
multivariate empirical process. The limiting distribution of is that of a 
Gaussian sheet Z^, for which Adler and Brown [2] proved that 



2(d-l)g-2c2 



(4.1) Kd,irc2('^-i)e-2'=' < p|supZ°(t) > c| < KdC- 

where is a constant depending only on d and K^ p is a constant depending 
on both d and the distribution F. For the case d = 2 with independent 
components Yi^i and Yi^2 of 1^, .Z^'^ is a pinned Brownian sheet, for which 
Hogan and Siegmund [20] sharpened (4.1) into 

(4.2) p(supZ°(t) >cl ~(41og 2)0^6-2^" asc^oo. 



I t 

In Section 5, we apply Corollary 2.9 to prove that if the sample size ric in- 
creases to oo with c such that c = o{nl^^), then we can replace Z^{t) in (4.2) 
by Zn^ (t) and also extend the result to general d and general distribution F 
such that 

(4.3) F is continuously differentiable and dF/dti > for 1 < i < d. 

In view of (4.3), we can apply a change of variables t — > F{t) and assume 
that F is a distribution function on the bounded Jordan measurable set 
[0,1]*^, agreeing with the assumptions in Corollary 2.9, whose notation (such 
as Vq) we use in the following theorem. 

Theorem 4.1. Let M = {t:F{t) = i} and assume that (4.3) holds and 
c = o{nl^^). Thenasc^oo, 



(4.4) 



p|supZ„^(t) >c| 



fQ2\d-l-2c^ 

~ oc e 



(4.5) 



/ \\VF{t)\\-'l[—{t)v,.,{dt), 
p|sup|Z„,(t)| >c| 

~2(8c^)'^-^e-2^' / \\VF{t)r'l[^it)v,.^{dt). 
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Corollary 4.2. (i) For d = 1 and continuous distribution function F, 
Pjsupj (t) > c} ~ e"^'^ asc^oo. 

(ii) For d = 2, if F{ti,t2) = Fi{ti)F2{t2) with continuous univariate dis- 
tribution functions Fi and F2, t/ien P{sup^ Z„^(t) > c} ~ (4 log 2)c^e~^'^ as 
c — > 00. 



Proof, (i) We can assume without loss of generality that Yi is uniform 
on (0, 1). In this case A4 = {^} and the integral in (4.4) is 1. 

(ii) Without loss of generality, assume that Fi(ti) = ti and ^2(^2) =t2, 
< ti,t2 < 1- In this case A4 = {(ni, M2) : U1U2 = ^, < ui, U2 < 1} and the 
integral in (4.4) becomes 

f UiU2 . , ^ /"^ 1/2 / M^^\ 

Im {ul + .i)V2-^(^-) = + (1/(2.0)^/^ V + M J 

/■I 1 1 

= / Ti—dui = -log2, 
Ji/2 2ui 2 

completing the proof for the case d = 2. □ 

For d=l, Smirnov [33] has shown that P{supt Z^{t) > c] = e-"^" for all 
c > and Corollary 4.2(i) yields a corresponding asymptotic formula for 
which was used by Chung [12] to prove an upper-lower class theorem 
for the Kolmogorov-Sniirnov statistic. Note that (4.5) says that for some 

constant k^, P{supjZn,(t)| > A.„} ~ Kd^'n'^ if A„ ^ 00 and A„ = 

o{n^l^). Since n{F„(i) - F{t)] is a partial sum of the empirical processes 
l{y.<j} — F{t), we can apply (4.5) and follow Chung's arguments to prove 
the following. 



Corollary 4.3. Let Xn be a nondecreasing sequence such that An ^ 00 
and let F be a distribution function on R'^ satisfying (4.3). Then Pjsupj |.^„(t)| > 
A„ i.o.} = (or 1; i/E^=i?^"^A2'^e-2^" < cx) (or = 00). 



An important difference between our proof of the upper-lower class re- 
sult in Corollary 4.3 and that of Adler and Brown [2] is that they first de- 
velop their results for the limiting Kiefer processes and then use the strong 
approximation theorem of Dudley and Philipp [14] whereas our approach 
works directly for the empirical process (and of course also for the limiting 
Kiefer process). The strong approximation approach involves embedding the 
given process in Brownian motion for which the integral test can be readily 
shown to hold by using, for example, the tangent approximation (1.1) to 
the boundary-crossing probability. For partial sums of stationary sequences 
having long-range dependence, the limiting process is no longer Brownian 



26 



H. P. CHAN AND T. L. LAI 



motion and strong approximation along the lines of Komlos, Major and 
Tusnady [23] , Philipp and Stout [27] and Berkes and Philipp [5] is no longer 
applicable unless one imposes very restrictive assumptions that are described 
in the next paragraph. However, the theory in Section 2 can still be applied. 

In particular, as in [13] and [19], consider partial sums Sn :=Z]i^« of 
linear processes 1^ := J2'jL-oo'^i-j^j where ej are i.i.d. random variables 
with mean 0, variance 1, E^e*'^^' < oo for some t > and {Tk}'^_^ satisfies 
J2'^oo'^k < "^^^ sequence Yi is said to have long-range dependence if 
E(YiYn+i) ~ n°'~'^L{n) for some 1 < a < 2 and slowly varying L so that 

(4.6) a'^{n) := Var(S„) ~ 2{a{a - l)}-^n°L(?i). 

Defining Zn{-) by linear interpolation with = Sk/<j{n) for t = (k) / a'^ (n) , 
Davydov [13] has shown that Zn converges weakly to a zero-mean Gaussian 
process (with correlated increments) whose covariance function is the same 
as that in (2.1) with d = l and rj = 1. Although strong approximation the- 
orems are not available for such Sn, Chan and Lai [9] have been able to 
derive integral tests of the type (1.3) for upper-lower class boundaries of 
Sn in the long-range dependent case by showing that assumptions (C) and 
(A1)-(A5) of Corollary 2.7 are satisfied by Xc{t){= X{t)) = 5Letj /cj( [e*J ) 
and Dc = [tc, t*] with c = o(e*=/6), {t* - tc)/c^/" ^ oo but t*-tc = ©(c") for 
some K > 0. Hence application of Corollary 2.7 yields an analog of Theo- 
rem 4.1 and therefore also the law of the iterated logarithm (LIL) for partial 
sums of long-range dependent linear processes; see [9]. Wang, Lin and Gu- 
lati [35] recently derived the LIL by using a strong approximation approach 
that requires to have the special form ~ k~^L{k) as A; — > oo for some 
i < /3 < 1 and = for A; < 0. 

Example 2.2 provides a prototypical example in change-point and signal 
detection problems, and Theorems 2.4, 2.5, 2.8 and their corollaries can 
again be applied to a variety of generalizations of Example 2.2 for these 
applications. Suppose we replace the Brownian motion W{t) by a Gaussian 
field X{t) and t2 — ti is replaced by Var(X(t2) — X(ti)); see [1] and [7]. Again 
conditions (C) and (A1)-(A5) can be shown to hold for these applications 
and also for their discrete-time analogues (like Sn in Section 3); see [10]. 

Suppose we replace the Brownian motion W{t) in Example 2.2 by a sam- 
ple sum process S^nct\ , where = Yi + • • • + y„ and the Yi are i.i.d. with 
mean 0, variance 1 and £'e*l^^l < oo for some t > 0. Then instead of X, we 
now have a random field Xc defined on D such that 

Xc{m/nc,n/nc) = {Sn - Sm)/{n - m)^/^ 

for m <n< an^. with ain^ < n — m < a2nc- 

The stopping time = inf{n : msiXn~a2nc<m<n~ainc {Sn - Sm)/{n - my'^ > 
c} has important applications in sequential change-point detection. Assum- 
ing that Uc/c^ ^ oo as c ^ oo and making use of moderate deviations theory. 
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Chan and Lai [11] have shown that X^. satisfies conditions (C) and (Al)- 
(A5). Therefore, analogous to (2.10), 

(4.7) P{T, < an,} - ij{c){c^ / A)[a{al^ - a^^) - log(a2/ai)]. 

This result provides an important tool for the choice of the threshold c and 
window sizes of the detection rule to ensure a prescribed false detection 
rate; see [24] and [11] where the asymptotic optimality (in the sense of 
quickest detection delay) and extensions (to multivariate Yi and Markovian 
Yi) of Tc are also given. 

5. Proofs of Theorems 2.1, 2.4, 2.5, 2.8, 4.1 and their corollaries. To 

study the asymptotic distribution (as t — > oo) of supQ<^<jX(s) of a station- 
ary Gaussian process with EX{s) = 0, Pickands [28] introduced a method, 
which has undergone subsequent refinements and is now commonly known 
as the method of double sums (cf. Chapter 2 of [29], [30, 31]), to derive 
the asymptotic behavior of P{supo<s<i Ar(s) > c} as c ^ oo. In this sec- 
tion, we modify the double sum method for non-Gaussian fields, to which 
powerful tools like Slepian's inequality and Fernique's theorem for the Gaus- 
sian case (cf. [29]) are no longer applicable. In particular, unlike the tradi- 
tional double sum J2 Ylii^j -f{sup„g/(i) X{u) > c, sup^^^o) X{v) > c} that is 
shown to be negligible relative to the single sum Z]i ^{sup„g/(i) X{u) > c} 
for stationary isotropic Gaussian fields (cf. [28, 29]), note that (2.12) involves 
P{sup„gj(,) Xc{u) > c, sup„geyj(,) Xc{v) > c} instead. 

The proof of Corollary 2.6 (or 2.7) involves covering D (or D,) by cubes 
of the form It,KAc and using a discrete approximation At{= At{a,m,c)) := 
{t + ha Ac - < ki < m, k G Z'^} of It,KAcJ where a = K/m. To distinguish 
from the scalar K = ma, we shall use k to denote the elements of 7/^. Since 
P{sn^^^i^^^^Xc{v) > c,Xc{u) < c - 7/c} < Na{-f)ij{c) by (A4), approxi- 
mating the tail probability of sup^g/^ Xc{u) by that of sup„g^^ Xc{u) 
has the error bounds 

P\ sup Xc{u)>c\ -pI sup Xc{u)>c\ U(c) 
P< c — 7/c < sup Xciu) < c > 
+ ^ p| sup Xciv)>c,Xc{u)<c-j/c\ 
< pjc - 7/c < sup Xc{u) < c\ /V(c) + {K/a)'^Na{-f) 



(5.1) 



V(c) 



uniformly for t € [D]s and 7a < 7 < c. The proof of Theorem 2.4 makes use 
of (5.1) and Lemma 5.1. Theorem 2.5 is introduced to provide a building 
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block to handle nonstationary random fields (or nonconstant boundaries) 
in Corollary 2.6 (or Theorem 2.8), which can be proved by much easier 
arguments in the case of stationary random fields; see Remark 5.1. 

Lemma 5.1. Under (C) and (A1)-(A3), 

HK,a{t):= r eyp[ sup Wt{a\^)>y\dy 

Jo iO<ki<m. J 

is uniformly continuous in t & [D]s o,nd sup^^^D^^ HK,ait) < oo. Moreover, 
for 7 > 0, as oo, 

PI sup Xc{u) > c — 7/c > 

(5.2) 

~ — 7/c)[l + HK,a{t)] uniformly for t G [D]s. 

Proof. Let e > 0. By (A3), there exists y* > 7 such that h{y*) < e/m'^ 
and 

< P j sup Xc{u) > c - 7/c| 

- P\ sup Xc{u) >c,c- y*/c < Xc{t) < c - 7/ci 

= p\ sup Xe(u) > c, X,{t) < c - y*/c] 

< 771'^ h{y* (c) <e^p{c), 

since = m'^- By (Al), there exists ^ such that 

(5.4) \P{Xc{t) > c - y/c}/^l^{c - y/c) - 1| = Oif,) 

uniformly for 7 < y < y*; we can also assume that (,~^iy* - 7) G Z. Since 
e^" = l+^c + 0{S,f) and ^(c - y/c) ~ eJ'^(c), (5.4) implies that 

P{c -{y + ic)/c < X,{t) < c - y/c} 

(5.5) 

= (1 + Oiec))e^'-Hic) - (1 + 0{e,))eym ~ eceV(c). 
By (A2), uniformly for t G [D]s and J <y <y* , 

p\ sup Xc{u) >c,c-{y + ic)/c < Xc{t) <c-y/c\ 
iueAt J 

(5.6) 

~p( sup Wtiak)>y]p{c-{y + ^c)/c<X,{t)<c-y/c}. 



(5.3) 
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Applying (5.5) to (5.6) and summing (5.6) over y = jS,c + 7 for j = 0, 1, . . . , 
^~^(y* — 7) — 1, we obtain (5.2) from (5.3) with arbitrarily small e. Since 
/q°° P{Wt{a\s.) > y} dy < 00 for all k and At is a finite set, HK,a{t) is finite 
and its uniform continuity follows from (2.1) and (2.2), with the convergence 
in (2.2) being uniform in t G [D]^ [see the sentence describing assumption 
(A2)]. Recall in this connection that sup^g^j^^^ggd-i rt{v) < 00, yielding the 
finiteness of supigj^)]^ ffi^^a(t). □ 

Proof of Theorem 2.4. Let a > 0. By (A4), (5.1) and (5.2), we have 
for all large c. 



0< 

(5.7) 



pI sup Xc{u) > c> - P< sup Xc{u) > c\ 



\d-. 



< 2(e> - 1)[1 + HK^ait)] + {K/afNaiia)- 

By (A4), for any e > 0, we can choose a* small enough such that iVa(7a)/o'^ < 
e/K'^ and 2(e^- - 1) < e for all < a < a*. Therefore, by (5.2) and (5.7), 

{l-e){l + HK,a{t)) 

(5.8) <pI sup Xc{u)>(\ U{c) 

<(l + 2e)(l + ifj^,,(t))+e, 

for all large c and all t G [D]s and < a < a*. We shall restrict a and a* 
to {2~^ -.j = 1,2,...} so that the integrand of HK,a{t) is monotone in a 
and increases to the integrand of Hxit) as a | 0. Hence by the monotone 
convergence theorem, HK,a{t) Hxit) as a — > 0. Therefore 

(5.9) 1 + HkA^) < 1 + HKit) < (1 + e)(l + HK^a* (t)) + e, 

for all t G [D]s and < a < a* (with a, a* G {2~^:j = 1,2,...}). We shall 
use (5.8) and (5.9) in conjunction with Lemma 5.1 to derive the desired 
conclusions of the theorem. 

First note that M := l + sup^gp]^ Hx{t) < 00 in view of (5.9) and Lemma 5.1 
and therefore 

(5.10) \HK{t)-HK,a'{t)\<{M + l)e for alH G [i?]^, 

by (5.9) with a = a* . Because Hx^a* is uniformly continuous by Lemma 5.1, 

(5.11) \HK,a'{t)-HK,a'{u)\<e \i \\t - u\\ < 5\t,u e[D]s, 

for some <5* > 0. Since \HK{t) - Hk{u)\ < |ifi^(t) - HK,a*{t)\ + \Hk{u) - 
HK,a*iu)\ + \HK,a'{t) - HK,a*{u)\, it follows from (5.10) and (5.11) that 
\HKit) - Hk{u)\ < 2(M + i)e + e if ||t - u\\ < 6*. As e is arbitrary, this 
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shows that Hk is uniformly continuous. Combining (5.8) with (5.10) and 
the definition of M yields that for all large c and t G [D]s, 

-e-eM-e2(M + l) < (^(c))-^p| sup Xc{u) > c \ - {1 + Hxit)) 

<£ + 2eM + 2e^{M + 1). 
Since e is arbitrary, this proves Theorem 2.4. □ 

Lemma 5.2. Under (C) and (A1)-(A4), suptg^j^^ /^>i ir"'^Fi<-(t) < oo 
and {K"'^Hk ■ K > 1} is uniformly equicontinuous on [D]^, that is, 
suPi^>i,t,sG[D]i,||t-s||<£ \K-'^HK{t) - K-'^Hk{s)\ ^ as e ^ 0. 

Proof. Without loss of generality we can restrict K to be integers. Take 
any positive integer a~^. Note that the integrand of HK,a{t) involves the set 
{ak:0 < ki < K/a}, which can be partitioned into K'^ disjoint subsets Lj 
such that \Lj \ = a~^. We can therefore use the arguments at the end of the 
proof of Lemma 5.1 to bound 

K-'^Y. ^^^P ^tia'k) >y]-p\ sup VF,(ak) > y 

and thereby establish the uniform equicontinuity and boundedness of 
{K~'^HK,a :K >1} on [D]s. Moreover, by partitioning the cube [0, K)'^ sim- 
ilarly into K'^ unit cubes, it can be shown that sup^>i^tg[£)]^ \K~'^HK{t) — 
K~'^HK,a{'t)\ ^ as a ^ 0. Hence we can proceed as in (5.10) and (5.11) but 
with HK,a and Hk replaced by K~'^HK,a and K~'^Hk to prove the uniform 
equicontinuity and boundedness of {K~'^Hk : > 1}. □ 

Lemma 5.3. Under (C) and (A1)-(A5), there exist constants — > 
as K ^ oo such that 



(5.12) p\ sup Xc{u)>c, sup 



for c large enough, uniformly over t £ [D]s and over subsets B of [D]^ with 
hounded volume. 

Proof. Let a > and < g < p. Then 

Ga:= E exp(||u;r)/(||u;||)<oo. 

toG(aZ)'* 

Let m,n be positive integers that are large enough such that 

53 exp(||^r)/(||«;||)<eaV8 

w(i{a7i)'^ ,\\w\\'>na 
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and 

[1 - (1 - 2nlmf\ < ea'^/8Ga. 

Let K = ma, Fi^t = {t + kaAcin < A;j < m - n,k E Z'^}, F2^t = \ 

Bt = {t + akAc eB\It,KA, : k G Z"^}, g^^ = inm{c-ja, i\\v-u\\'/Ac)''}. Then 

by (A5), 

P{Xc{u) > C - ija + gu,v,c)/c,Xc{v) > C - {^a + 9u,v,c) / c} 

(5.13) < ^(c - (7a + guv)/c)f{\\u - v\\/A,) 

<2e'-^^P{c-^a/c)f{\\u-v\\/A,), 

for all large c and small a. For u € Fi^j and v G i?^, ||ii — f ||/Ac > na and 
guv < i\\u - u||/Ac)^. Noting that \Fi[t\ < m'^, |F2,t| < m'^ - {m - 2nY = 
m'^[l — (1 — 2n/mY], and that Z^ttg^t = I^j=i SueFj t' '^^ obtain from (5.13) 
that for all large c and small a, 

H H -P{-'^c(^^) > c- (7a + 9„t,)/c,Xc(t;) > c- (7a + 5r™)/c} 
<^(c-7a/c)m'^ 

(5.14) 

X I 5] eM\M'')f{\\M\) + [1 - (1 - 2n/m)'^]Ga| 

<(eKV2)^(c-7a/c). 
Define A^, = min^g^^ g^w w £ Bt, and = if w G . Then 

P< sup Xc(n) > c, sup Xc(v)>c> 

(5.15) < E E P{Xc{n)>c-{j )/c,Xc(t)) > C - (7a +5nD)/c} 

+ E P| sup Xc{z)>C,Xc{w)<C-{-fa + Xw)/c\. 

On the right-hand side of (5.15), the first sum can be bounded by (5.14) and 
the second sum by 

J2 P{ sup Xc{z)>c,Xc{u)<c-'ya/c\ 

(5.16) + E ^1 sup Xciz)>c,Xciv)<c-{^a + X,)/c\ 

< (K/a)'^7Va(7a)V'(c) + E ^'^(^^ + ^-)V'(c), 
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in view of (A4) and that = m'^ = {K/a)'^ . To bound the last sum X^ueBt 
in (5.16), first consider the case d = l. Since A^, > min{(aA;)'', c — 7a} if 
a/cAc < inf^g^j |?; — ti| < a{k + l)Ac, and since Na is nonincreasing, it fohows 
that 

Na{-1a + K)^{c) 

vGBt 

(5.17) < 2|f; iVa(7a + {am + Naic)v{B)/iaA,)^ 

< 2|a-i 1^ Na{la + y") dy + v{B)Na{c) / {ai:^. 

Integration by parts shows that the integral in (5.17) approaches as a ^ 0, 
since Na{'^a) + w^Na{'^a + w) dw = o{a) for s > {q~^ — 1)+. Moreover, in 
view of (2.5), Na{c)/l^c = OU^J'^^ w^Naija + w) dw) = o{a) as a ^ and 
c — > oo, for s > 2/a. Therefore, J2veBf ^aila + ^v) < £/4 for all large c and 
small a. In general, for d> 1, 

veBt 

(5.18) < 2i^dp^{a-'K + 2jf-'Na{ja + (aj)") + Na{c)v{B)/{aA,f^ 

< eK'^~^ /A for all large c and small a, 

as can be shown by arguments similar to those in the case d = l. Combining 
(5.15) with (5.14) and (5.16)-(5.18) yields the desired conclusion. □ 

Proof of Theorem 2.5. Let 1 > e > 0. There exists K* such that 
SK<e/^ for ah K>K*. For fixed t^D <mdK>K*, define 

A = G (KAeZ)'^ : /„,i^A, C /f,4A J, 

(5.19) _ 

A = {n G {KAcZf : Iu,KA, n lu^A, / 0}, J„ = Iu,KA,- 

Covering It/^Ac by cubes of length KAc and letting be a subset of [D]s 
containing It/^Ac and such that v{B) < vq, we have 



P< sup A'c(f ) > C > — P< sup Xc{v) > C, sup A'c(l(i) > c> 

< pI sup Xc{v) > cj < ^ P| sup Xc(f ) > cj. 
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By Theorem 2.4 and Lemma 5.3, as c— > oo, 
(1 + o(l))V(c) [Hk{u) - skK''] 

(5.21) 

<p| sup Xe(«)>cj<(l + o(l))V^(c)^ifK(n), 

uniformly in t £ D. In view of ^c^c and the uniform equicontinu- 
ity in Lemma 5.2, we can choose c* large enough so that \K"'^Hk{u) — 
K-^HK{t)\ < e/3 for all c > c*, ^/^c > K > K* , t £ D and u £A 
{= A{t;KAc,ic^c))- Putting this and the bound sk < e/3 in (5.21) and 
dividing (5.21) by £fV'(c), we obtain ior all c> c* , ^/I^> K > K* and t G D, 

{l-e){K-''HK{t)-2e/3}<p{ sup X,{v) > c] / {iiiP{c)) 



(5.22) 



<il + e){K-''HK{t) + e/3}, 



since |A| ~ |A| ~ {tc/Kf- By Lemma 5.2, M := supt^^j;)^^^^^^ K-'^Hxit) < 
oo. Therefore, it follows from (5.22) that 



(5.23) sup 

teD 



p{ sup X,{v)>c]/{eii;{c))-K-^HK{t) 



< eM + 2e/3, 



for all c > c* and > > K* . Letting c ^ oo in (5.23) yields 

sup \K-'^HK{t) - k-'^H^{t)\ < 2eM + 4e/3, 
teD 

if K > K* and K > K*, establishing that {K'~'^Hk} is uniformly Cauchy. 
Hence K~'^HK{t) converges uniformly in t S D to H{t), which is also bounded 
by M. We can therefore proceed as in the second paragraph of the proof of 
Theorem 2.4 to show that H{t) is uniformly continuous in t G D. Moreover, 
taking K large enough such that sup^g^) \K~'^HK{t) — H{t)\ < e/3, it follows 
from (5.23) that 



sup 

teD 



pI sup Xc{v) > c 
'<veIt,ecAc 



'{iii;{c))-H{t) 



<e{M + l) 



for all c > c*, proving (2.11). 

We next show that miteDH{t) > 0. For the function / in (A5), we can 
choose a > large enough so that J2kj^o fi^^^) ^ 1/2- Let K = ma and define 
At = At{a, m, c) as in the paragraph preceding Lemma 5.1 so that |^t| = m'^- 
Then by (Al) and (A5), as c— > oo. 



P< sup Xc{u) > c 
iueAt 
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> ^ P{X,{u) > c} - P{^c{u) > c,X,{v) > c} 



(5.24) 




> 5:(l + o(lMc)/2 



ueAt 



(l + o(l))m>(c)/2, 



uniformly in t £ D and m > 2. Combining (5.24) with Theorem 2.4 yields 



for all m > 2 and t £ D. Since lim/^^oo-^ '^Hx{t) = H{t), it then follows 
that H{t) > a-'^/2 for ah t G D. Finally, to prove (2.12), apply (5.12) to 
obtain that for all t G D and large c, 



Since Si^ ^ as ^ oo and |A| ~ (ic/Kf as ic/K oo, (2.12) follows. 



Proof of Corollary 2.6. A basic idea of the proof is to cover the 
bounded, Jordan measurable set D by cubes of length ^c^c, with — *■ oo 
such that 4Ac 0. Define A, A and J„ as in (5.19) but with (KAcZ)'^ 
replaced by (fcAcZ)"*, Iu,ka, by Iu/,Ac, and It,e,Ac by D. Then (5.20) stiU 
holds with these new definitions of A, A and J„ and also with B replaced by 
the bounded set [D]s. Labeling it as (5.20'), the upper and lower bounds in 
(5.20') are both asymptotically equivalent to (4Ac)~'^^c^(c) Jj^H{t)dt by 
Theorem 2.5, since ^c^c — ^ and H(t^ is continuous. CH 

Remark 5.1. Corollary 2.6 can be proved by easier arguments, to be 
sketched below, when Xc{t) = X{t) is stationary. Let 







< \A\sKK'^i^ic). 



□ 



Aj = {teD:t£{JAc)'^}, 
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Ft = { sup X{u)>c — j/c 

^uS:At{a,K/a,c) 

= ■{ sup X{u)>c — j/c 

^u(^At{a,K /a,c) 



Then 



(5.25) 



teAK 



< 



E PiPt] 

teAK 



P{F) 



y: p{Ft) - p{F) 

tGAf- 



It can be shown by arguments similar to those in the proof of Lemmas 
2.3 and 2.4 of [31] that hmsup,^^ | EteA^ P{Ft) - P(F)|/{V(c)A-^} ^ 
as — > oo, a ^ and 7^0. Moreover, by Lemma 5.1 and stationarity, 

(5.26) P(Pt) ~ v{D){KA,)-''i,{c - 7/c)(l + HK,a), 

teAK 



and a similar relation also holds for X^teA^ P{Ft)- Hence by (5.25), 

as ii', i^T — > oo, a, a — > 0, 



(5.27) \K^'^HK,a-K~'^H 



K,a\ 

which implies that linix^oo.a^o K~'^HK,a exists by the Cauchy convergence 
property, yielding H as the limit. For nonstationary random fields, we do 
not have the simple relation (5.26) and cannot show the existence of the 
limit of K~'^HK,a{t) via Cauchy convergence as in (5.27). This is why more 
complicated arguments are needed in the proofs of Lemma 5.3 and Theo- 
rem 2.5, from which Corollary 2.6 follows. Concerning the proofs of Theo- 
rems 2.4 and 2.5, since H^^a and H are defined by the Gaussian processes Wt 
rather than the process Xc satisfying (A1)-(A5), one may wonder why these 
assumptions have been involved in their proofs (and also that of Lemma 5.1) 
to establish continuity and boundedness properties of HK,a and H. It turns 
out that for a Gaussian random field Xc = X whose covariance function 
satisfies condition (C), assumptions (A1)-(A5) also hold with Wt being the 
limiting process in (A2); see the following proof of Theorem 2.1 which gen- 
eralizes the Qualls-Watanabe result (2.6) to nonstationary Gaussian fields. 

Proof of Corollary 2.7. Here we modify (5.19) into 
(5.28) Kc = {ue{Qc^f■.Iu,c.r^Dc = 0}, 
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and replace B in (5.20) by [Dc]s so that we have here a corresponding 
version of (5.20), labeled as (5.20*). Apply (2.12) with 4 = Cc/^c together 
with (2.14) and (5.20*) to derive (2.15). □ 

Proof of Theorem 2.8. It follows from (2.11) and (2.16) that 
(5.29) P{X,{u) > bciu) for some u £ It,^J ~ iCc/Af,^(t))Uibcit))H{t). 

From (2.12) with the boundary c replaced by b^{t) and with = (c/^c, it 
follows that 

P{Xciu) > bciu),Xciv) > max{bciv),b^{t)) 

for some u € It^c^^ It^^J 

(5.30) 

<P\ sup Xc{u)>b^{t), sup Xc{v)>b^{t)\ 

= o((Ce/A,^(i))'^V(ic(i))) 

uniformly over t £ Dc and over subsets B of [D]s with bounded volume. 
Then 



E 



P{Xc{w) > bc{w) for some w £ Ju} 
- P{XcH > bciw),X,iz) > max(6,(z),6,(n)) 



(5.31) for some w S Ju, z G J^,} 

< P{Xc(u) > bc{u) for some u £ Dc} 

< ^ P{Xc{w) > bc{w) for some w G Ju}, 

in which and Ac are defined by (5.28). By (5.29) and (5.30), the lower and 
upper bounds in (5.31) are asymptotically equal. Since Cc 0, the desired 
conclusion then follows. □ 

Proof of Corollary 2.9. Since a <2, there exists e > such that 
Ac = o(c~(i+^)). We can therefore choose — > and ^ such that 

(5.32) Cc/Ac^oo, ec>c"i log c, ^^^^^^^^-2)^ 

so Cc = o(Cc)- Consider the tubular neighborhood U^^ of M. For sufficiently 
small ^, the elements of can be uniquely represented in the form x + y 
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with X G y G TM (y) and ||y|| < ^. Since V6(t) = for aU t belonging 
to the compact set Ai, there exists B > such that ||V6(u)|| < i?^c for all 
u G [U^j2Cc- Combining this with (5.32) yields 

sup b{u) — inf b{u) = O(CcCc) = o(c~^) 

uniformly over t G [U^J\2C,c.- 
Recalling that bc{u) = cb{u) and applying the identity y"^ — = {y — x){y + 
x), we can conclude from (5.33) that sup^gfj/^ [^c(*) ~^c(^)] 

Let 2/ G and z G ^-^(y). Then b{y + z) = bD + z'V^b{y)z/2 + 0{\\zf). 
Applying Theorem 2.8 to Dc = U^^ yields 

P{Xc{t) > cb{t) for some t G C/g J 



~A-M il,{cb{t)){b{t)f'^/'^H{t)dt 

(5.34) 

~A->(c6,,)6^"/" 

X / F(y) / eM-c^bDz'V\y)z/2) dzvgidy). 

Since V5_b(y) is positive definite, inf„g£)\^^^ 6(n) > bjj + B'^^ for some B' > 
0. Hence by Theorem 2.8, 

P{Xc{t) > cb{t) for some t G L> \ i/g J 

(5.35) <P( sup X,{t)>c{bD + B'il)\ 

= o(A-'^V(c6d)), 

in view of (5.32). Combining (5.34) with (5.35) and evaluating the inner 
integral in (5.34) give (2.19). □ 

Proof of Theorem 2.1. We shaU show that (A1)-(A5) hold for the 
Gaussian random field X satisfying (2.7), which is the same as condition 
(C) in the present case Xc = X , and hence Theorem 2.1 follows from Theo- 
rem 2.5 and Corollary 2.6. In particular, (Al) follows from the well-known 
asymptotic tail behavior of a normal distribution. Let p{t, u) = E[X{t)X{u)]. 
Since the conditional distribution of X{t + uAc) given X{t) is normal with 
mean p{t,t + uAc)X{t), it follows from (2.7) that as c— >oo, 

E{c[X{t + uA,) - X{t)]\Xit) = c - y/c} 

(5.36) =-c[l- p{t,t + uA^)]{c-y/c) 
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(5.37) 



--||nrr,(VII^||)/2, 
Cov{c[X{t + uAc) - X{t)],c[X{t + vAc) - X{t)]\X{t) = c - y/c} 
= [p{t + uAc, t + vAc) - pit, t + vAc)p{t, t + uAc)] 

[-\\v - u\\"rt{{v - u)/\\v - u\\) 

+ \\vrn{v/\\v\\) + \\urrt{u/\\u\\)]/2. 

Since {c[X (t + akAc) — X{t)] : < fej < m} is multivariate normal, (A2) then 
follows. Let 7 > 0. Since ^p{c — z/c) ^ e^tp{c) for all z > and there exist 
constants B,B' >0 such that P{Wt{u) > z - < B exp{-B' z"^), it follows 
from (5.36) and (5.37) that as c— > oo, 

P{X{t + uAc) > c - 7/c, X{t) <c-y/c} 



< (1 + o(l))V'(c) / e'P{Wtiu) >z--f}dz 

where h{y) — > as y — > oo, establishing (A3). To show that (A5) holds, note 
that 

P{X{t) > c, X{t + uAc) > c} 

< P{X{t) + X{t + uAc) > 2c} 



2c' 



1 + p{t,t + uAc) 

n + p{t,t + uA, 
V 2 



1/2 



1/2 



exp 



l + p{t,t + uAc, 



+ 



(? fl-p{t,t + uAc) 



< ijj{c) exp 

By (2.7), there exists r/ > such that c2[l - p{t,t + uAc)] > tjWuW^ L{\\u\\) 
for all t,t + uAc E [Djs- It then follows from (5.37) that (A5) holds with 
f{u) = Bxexjp{—u^) with < A < a, for some Bx > 0. 

To prove (A4), we use a technique of Fernique [16]. Let a > 0, < ^ < a, 
1 < e < 2^/2, K = Er-oC"'^ and Wr = e"72K. Define 

Br = {t + A;2"''aAc : < /cj < 2"', fcj G Z}, 



(5.38) 



F=l sup X{u)>ci, 



E 



= {X(t)<c-7/c}, 

Er = < sup X{v) < C — j{l — Wq — Wr)/c> 



for r > 0, 
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recalling that X^J^o^r ~ |- Note that Br C i?r+i C It,aAc and that by the 
continuity of X, P{F nE^i)< Y.^Lo P{Er^i D E^). Moreover, 

(5.39) < 2'"+"' sup P{X{v) < c - 7(1 - wo Wr-i)/c, 

£e{o,i}'*\{o} 

X{v + e2~''aAc) > c - j{l - wq Wr)/c}. 

Given X{v) = c — y/c, the conditional distribution of c[X{v + e2~'^aAc) — 
X{v)] is normal with mean —c{c — y/c)[l — p{v,v + e2~^'aAc)] <0 and vari- 
ance c^[l — p^{v,v + e2~''oAc)], which is bounded by B[a2~^)'~- for some 
-B > 0, in view of (2.7). Hence 

P\ sup c[X{v + e2~''aAc)-X{v)]>Wry\X{v)=c-y/c\ 

(5.40) 

<2'^eM-C{wryf/{a2-'-f] 

for some C > 0. Similarly, X{v + e2~^) — X{v) has mean and variance 
bounded by B' {a2~'^)'~- / for some B' > in view of (2.7). Hence by choosing 
C small enough, 

p\ sup c[X{v + e2-'^aAc) - X{v)] > } 

(5.41) 

< 2'^ exp[-C{wrP)'^c^ /ia2-'-)'^]. 

Let ?7 := 2^/^^ > Combining (5.39)^(5.41) with P{X{v) ec-dy/c} ~ 
ip{c)ey dy then yields 

P(Fn^_i) 

(5.42) < (1 + o(l))V'(c) y 2-" / exp[y - Cry'^yV(4«^^^) + C'r] dy 



+ 2"" exp[-Cr/'"/32cV(4a^ Ac2) + C'r] 

r=0 

for some C > 0. Let 7^ = a^/^ and take (3^ > {2a^K^)/C + A with A > 0. 
Then for all large c and 7a < 7 < c, (5.42) is bounded above by il:{c)Na{"f), 
where 

Na{j) = 2j22-'-\ / exp[y-Cr7V/(4a'^'^') + C"r]dy 



+ exp[-C7r?''A7V(4a«K2) + C'r] 
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satisfies Na{-fa) + v'^aila + y)dy = o{aP) for all s > and p > 0. □ 

Proof of Theorem 4.1. Take 6 > and lei D = {t:26 <ti < 1 - 25 
for all i}, 

T(^)={F(^)(l-F(^))}^/^ r* = inf Tit), 

telD]s 

(5.43) 

X,{t)=ZnAt)/T{t), b,{t)=c/T{t). 

Note that Xc{t) has mean and unit variance. We now show that condi- 
tions (C) and (B1)-(B5) with Dc = D hold for Xc{t). In view of F{t + u) = 
F{t) + u'VF{t) + o(||m||) and a similar Taylor expansion for r(t + u), 

p,{t, t + u)= F{t){l - F{t + n))/{r(t)T(t + u)} 

= 1 - (1 + o{l))u'VF{t)/{2F{t){l - Fm 

as u — > 0. Hence (C) is satisfied with L(||n||) = 1, a = 1, rt{u) = u'VF{t)/ 

{2F(t)(l - F{t))} and = {2c^)~^. Since c = o{nJ^) and ^ZnM is 
a sum of i.i.d. bounded random variables, (Bl) holds by moderate devia- 
tions theory (cf. [15], Theorem 16.7.1). Moreover, conditioned on Fn^{t) = x, 
Fnc{t + uAz) = x + W/ric, where is a Binomial(n,p) random variable with 
n = nc-x andp = {F{t + uAz)-F{t)}/{l-F{t)). Making use of this and 
the functional central limit theorem, it can be shown that (B2) holds and 

E{z[X,{t + nA,) - X,{t)]\X,{t) = z - y/z} 

(5.44) 

--nVF(t)/{4F(t)(l-F(t))}, 
Cov(z[Xe(t + uA,) - X,{t)],z[X,{t + vA,) - X,{t)]\X,{t) = z- y/z) 

(5.45) 

BF 

^Y.^,n{u,,y^) — {t)/{2Fm-Fm. 
1=1 * 

uniformly over bounded, nonnegative values of y and over t G [D\s and c/2 < 
z <c/t* . Note that (5.44) and (5.45), which are analogous to (3.12) and 
(3.13), give the mean and covariance functions of the limiting Gaussian 
process Wt{u) in (B2) and are in agreement with the a and rt of condition 
(C). The proof of (B3) and (B5) uses ideas similar to those in the proofs 
of Lemma 3.6(ii) and Lemma 3.7, together with large deviation (instead of 
Berry-Esseen) bounds for sums of i.i.d. bounded random variables. 

To prove (B4), we modify the preceding proof of (A4) in Theorem 2.1 as 
follows. Let o > 0, 1< C < V^, K = E^o^"^ ^r- = C/2k and c/2<z< c/t*. 

— 1/2 

Pick rz such that 6 < 2^^znc < 29, in which 6 will be specified below. For 
ZnAv) > ZnAu) - nl'^[F{v) - F{v - a2-'^A,)] 

(5.46) 

> Zn^{u) - LOZ \ 
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where uj > can be made arbitrarily small by choosing 9 large since ric 2~'^^ 
lies between 9~^z and 9~^z/2. Making use of (5.46), we can choose 9 large 
enough such that 

j sup z[X,{u) - X,{v)] > 7/2! n {X,{v) <z- 7/(2z)} 

(5.47) 

= 0. 

For fixed z and r > 0, define F,E-i,Br and Ej. (r > 0) by (5.38) in which 
c is replaced by z and X{-) by Xd-). Then P(F n E_i) < P{F Ci ErJ + 
J21Lo P{^r-i n £J^). We can then proceed as in the preceding proof of The- 
orem 2.1, using bounds for binomial (instead of normal) tail probabilities. 

Verification of (C) and (B1)-(B5) enables us to apply Corollary 2.9 af- 
ter introducing the change of variables t ^ F{t) so that is a distribution 
function on [0,1]*^ (see the paragraph preceding Theorem 4.1). By (5.44), 
(5.45) and Lemma 2.3, H{t) = {lltiidF/dti){t)} /{AF{t){l- F{t))Y . More- 
over, inftgz)l/{F(t)(l - F{t))y/^{= bo) = 2 when 5 is sufficiently small, 
and \Vlh{t)\ = \\VF{t)f{F{t){l - F(t))}-3/2 and F{t) = 1/2 for alH G A^. 
Hence, applying Corollary 2.9 to D and then letting J ^ 0, we obtain 
(4.4). Since the probability of joint occurrence of {sup(Z„^(t) > c} and 
{inff Z,j^(t) < — c} is negligible compared to (4.4), (4.5) follows from (4.4). 
□ 
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